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The  repair  and  overhaul  of  military  equipment  is  a costly  and 


complex  logistics  activity.  Factors  that  may  have  significant  impact 


upon  scheduling  decisions  in  such  systems  include  costs  of  set-up. 


production,  and  expediting,  obsolescence  probabilities,  the  avail- 


ability of  the  reparable  assets,  manpower,  equipment  and  funds 


required  to  support  the  repair  effort.  This  paper  reviews  the 


current  state-of-the-art  for  solving  multi-item  repair  scheduling 


problems  in  such  systems,  and  presents  an  algorithm  for  solving 


these  problems  using  Generalized  Upper  Bounding  with  dynamic  pro- 


gramming subproblems.  Computational  experience  involving  up  to 


170  items,  48  constraints,  and  12  planning  periods  is  also  reported. 
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Multi-Item  Scheduling  In 
Reparable  Item  Inventory  Systems 
With  Reflection  Programming 
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I.  Introduction 

The  depot  level  repair  and  overhaul  of  military  equipment  Is  an  Important 
and  costly  logistics  activity.  In  the  Air  Force  Logistics  Command  alone,  depot 
maintenance  support  accounts  for  the  work  of  about  40,000  persons  and  requires 
annual  expenditures  of  over  a billion  dollars. 

An  Important  aspect  of  depot  maintenance  Is  the  development  of  repair 
schedules  and  manpower  plans  which  result  In  the  efficient  use  of  reources 
while  providing  high  levels  of  support  to  customers  of  the  Inventory /repair 
system.  Ideally,  the  development  of  such  plans  requires  simultaneous  consider- 
ation of  the  magnitude,  tlmephaslng,  and  priority  of  alternative  repair 
programs  and  the  availability  and  cost  of  the  skills,  equipment,  facilities, 
and  funds  required  to  support  these  programs.  This  Implies  the  need  to 
collect  and  manipulate  large  masses  of  data  and  to  make  a number  of  trade-off 
decisions  to  obtain  efficient  use  of  available  resources. 

Until  recently,  the  very  large  number  of  variables  associated  with  depot 
repair  planning  and  the  fragmented  nature  of  "second  generation"  data  systems 
have  generally  precluded  the  use  of  mathematical  programming  techniques  to 
assist  In  the  repair  planning  process.  The  advent  of  powerful  new  techniques 
for  solving  large  scale  optimization  problems , the  trend  toward  integrated  data 
systems,  and  the  availability  of  modern  computers  with  tremendous  memory  and 
computing  power  indicate  these  problems  could  diminish  for  many  repair  organi- 
zations during  the  current  decade. 
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In  this  paper  we  present  a method  for  solving  repair  scheduling  and  man 
power  allocation  problems  using  large  scale  optimization  techniques.  The 


paper  has  five  sections.  Section  I provides  background  on  the  nature  of  the 


repair  scheduling  problem  and  reviews  the  current  state  of  the  art  In  this  area 


Section  II  presents  a deterministic  mixed  Integer  model  of  the  repair  scheduling 


problem.  Section  III  discusses  how  linear  programming  might  be  applied  to 


obtain  approximate  solutions  to  the  original  integer  optimization  problem 


while  Section  IV  discusses  how  reflection  programming  may  be  applied  to  obtain 


heuristic  solutions  to  this  problem.  Finally,  Section  V presents  computational 


results  for  the  latter  two  solution  methods 


Background 


The  development  of  depot  repair  plans  Involves  two  basic  categories  of 


(a)  Uorkloadlng,  which  determines  the  specific  Items  to  be  repaired 


the  quantities  Involved,  and  when  and  where  the  repair  Is  to  be 


Resource  allocation,  which  determines  how  available  resources  should 


be  adjusted  and  allocated  to  support  assigned  repair  workloads 


In  reaching  the  above  decisions,  it  Is  necessary  to  strike  a good  balance 


between  two  conflicting  objectives:  providing  high  levels  of  support  to  customers 


and  efficient  use  of  available  resources 


Figure  II-l  shows  some  of  the  major  factors  that  may  have  Important 


Influences  In  the  development  of  cost-effective  depot  repair  plans.  As 


Illustrated  In  the  figure,  several  constraints  usually  must  be  satisfied  In 


developing  meaningful  repair  plans  and  programs.  Limitations  on  the  availability 


of  skills,  equipment,  facilities,  and  funds  may  preclude  doing  all  desired 


repair  programs  within  specified  time  limits,  while  legal,  administrative 


or  policy  constraints  established  by  higher  authorities 


.producitivity  effects 

.setup  and  calibration  time 
.learning  curve  effects 
.inventory  carrying  costs 
.efficiency  of  scale 

.alternate  sources  of  repair 
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Figure  I-l  Factors 
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Executlve  Branch,  may  further  restrict  the  range  of  alternatives  available  to 
repair  planners.  Addltonally , the  limited  availability  of  reparable  assets, 
subassemblies,  and  "bits  and  pieces"  needed  In  the  repair  process  may  also  make 
certain  work-loading  decisions  Infeasible  or  uneconomical. 

Economic  factors  that  may  have  an  Important  bearing  on  the  development 
of  repair  plans  Include  workforce  wage  rates,  costs  of  manpower  adjustments 
(over-time,  hiring,  layoff,  training,  transfers),  and  costs  for  the  maintenance, 
modernization  or  augmentation  of  existing  equipment  and  facilities.  Other 
economic  factors  having  Important  Impacts  In  certain  circumstances  Include 
times  required  for  the  setup  and  testing  of  complex  repair  equipment,  learning 
curve  effects,  and  the  availability  of  alternative  sources  of  repair,  e.g., 
qualified  subcontractors.  Support  effectiveness  considerations  Include  the 
essentiality  of  the  work  to  be  done  and  the  uncertainty  associated  with  the 
repair  requirement. 

The  planning  horizon  under  consideration  may  also  have  an  Important  Impact. 
Plans  that  are  to  be  implemented  within  the  next  month  require  far  more  detailed 
scrutiny  than  plans  that  are  to  be  Implemented  in  future  fiscal  years.  Further, 
less  uncertainty  Is  generally  associated  with  them. 

Another  major  factor  Is  the  organizational  momentum  created  by  the  planning 
process  Itself.  In  most  organizations.  Intermediate  and  long-range  plans  provide 
the  basis  for  contractual  agreements  with  suppliers  and  subcontracts  and  for 
carrying  out  of  long-term  personnel  training  programs.  Once  established,  such 
agreements  and  programs  are  usually  difficult  and  expensive  to  modify. 


Current  State  of  Knowledge 


Studies  to  determine  economic  order  and  repair  quantities  for  single  item 


4 

i ^ 


repair  systems  have  been  reported  by  several  authors.  These  Include  the  work 
of  Alien  and  D'Esspo  (1968),  Brown  (1969),  Demmy  (1970),  Frelheit  (1967), 
Hastings  (1967),  Krause  (1970),  Schrndy  (1967),  Sherbrooke  (1966),  Sljerhrooke 


(1968),  Slnon  (1969),  PorCeous  and  Landsdowne  (1973),  Faucett  (196^,  Muckstadt 
(1973),  and  Faucett  (1972).  Several  other  studies  aimed  at  applying  Sherbrooke's 
METRIC  model  to  Air  Force  requirements  computations  have  been  completed  by 
the  Management  Sciences  Office  (AFLC/XRS) , Headquarters  Air  Force  Logistics 
Command,  Wright  Paterson  Air  Force  Base,  Ohio.  These  studies  provide  results 
for  computing  spares  acquisition  quantities,  or  for  scheduling  In  single  Item 
systems;  however,  they  do  not  provide  techniques  for  scheduling  Item  repair 
when  several  resources  (e.g.  manpower,  funds,  or  test  equipment)  limit  scheduling 
flexibility. 

Another  Important  line  of  research  Is  the  development  of  techniques  for 
solving  multi-item  scheduling  problems  In  manufacturing  Industries.  The  problem 
of  scheduling  the  production  of  many  Items  over  time  was  first  studied  via  linear 
programming  by  A.  S.  Manne  (1958).  Additional  work  along  these  lines  has  been 
done  by  Dzlelinskl,  Baker,  and  Manne  (1963),  Dzlellnskl  and  Gomory  (1964), 

Kortanek,  Sodaro,  and  Soyster  (1968),  Gornsteln  (1970),  Lasdon  and  Terjung  (1971), 
Demmy  (1973) , Demmy  and  Brock  (1974) , Demmy  (1975) , and  Gornsteln  (1976) . 

Dzlelinskl  and  Gomory  applied  the  Dantzig-Wolfe  Decomposition  Principle  to  a 
problem  very  similar  to  that  formulated  by  Manne  (1958) . The  resulting  linear 
program  has  a very  large  number  of  variables  and  possibly  many  constraints, 
implication  of  the  decomposition  principle  yields  an  equivalent  linear  program, 
called  the  master  program,  with  fewer  constraints  but  even  more  variables. 

However,  these  may  be  dealt  with  by  a column-generation  technique,  using 
•ub-problems . For  the  problem  studied,  these  problems  were  of  the  Wager-Whlttln 
(1958)  type  and  may  thus  be  solved  efficiently.  Gornsteln  (1976)  describes  how 
this  method  was  Implemented  as  the  basis  for  production  planning  in  a major 
stamping  plant. 

Although  the  decomposition  algorithm  of  Dzlelinskl  and  Gomory  Is  an  attractive 
approach,  difficulties  still  remain.  The  most  serious  of  these  is  that  the 
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linear  program  being  decomposed  Is  only  an  approximation  to  an  Integer  programming 
problem  whose  solution  is  actually  desired,  and  Is  a good  approximation  only  when 
the  number  of  items  is  much  greater  than  the  number  of  time  periods.  Under 
these  conditions  basic  solutions  to  the  linear  program  have  the  property  that 
most  of  the  variables  will  have  Integer  values.  This  property  is  not  shared  by 
the  master  program  of  the  decomposition  principle.  Thus  the  Dantzlg-Wolfe 
decomposition  approach  cannot  guarantee  a majority  of  Integer-valued  variables 
until  optimality.  A second  problem  is  that  the  reformulated  problem  may  have 
a tremendous  number  of  near  optimal  solutions  prior  to  optimality,  leading  to 
extremely  long  computing  times  in  arriving  at  an  optimal  solution. 

Lasdon  and  Terjung  (1971)  proposed  that  the  linear  program  formulation  of 
Hanne  be  attached  directly.  In  their  approach,  the  large  number  of  columns 
is  handled  by  column  generation  via  sub-problems.  The  multiplicity  of  con- 
straints is  dealt  with  by  using  Generalized  Upper  Bounding  (GUB)  to  reduce 
the  effective  basis  to  a much  smaller  size.  Although  the  method  does  not  guarantee 
integer  solutions,  the  round-off  problem  Is  much  less  severe  In  the  practical 
problems  reported.  An  extended  version  of  the  Lasdon-Terjung  model  forms  the 
core  of  an  automated  production-scheduling  and  inventory-control  system 
currently  being  used  by  a major  U.S.  manufacturer. 

Denmy  and  Brock  (19 7A)  present  a general  prodedure  for  depot  repair 
planning  based  upon  a large-scale  linear  programming  model  of  the  repairs 
scheduling  process.  Factors  considered  In  this  general  model  Include  con- 
straints on  overtime,  manpower,  equipment,  facilities,  and  funding.  Economic 
factors  considered  Include  personnel  costs  related  to  wages,  overtime,  hiring, 
lay-off,  training,  transfers,  and  attrition,  costs  for  equipment  and  facility 
maintenance,  modernization,  and  expansion,  producltlvty  effects  related  to 


set-up  and  callEration  time,  learning  curve  effects.  Inventory  carrying  costs. 
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repair.  Although  the  Demmy-Brock  model  is  very  general,  It  appears  that 
currently  existing  large  scale  mathematical  programnlng  packages  such  as  MPSX 
(IBM),  APEX-2  (CDC),  LP/6000  (Honeywell)  may  be  used  to  solve  the  model  for 
aggregate  planning  problems  such  as  those  faced  by  headquarters  organizations. 
However,  because  of  the  very  large  number  . * Variables  associated  with  de- 
tailed scheduling  problems,  special  techniques  must  be  developed  to  solve 
these  latter  problems  In  a reasonable  amount  of  computer  time. 

Demmy  (1973)  developed  an  algorithm  for  solving  a simplified  version  of 
the  Demmy-Brock  model  using  the  Dantzig-Wolfe  decomposition  procedure.  Al- 
though computational  expedience  with  test  problems  Involving  up  to  90  items, 

12  constraints  and  4 planning  periods  was  encouraging,  the  computational 
difficulties  related  to  the  Dantzlg-Wolfe  decomposition  formulation  remained. 
Later,  Demmy  (1977)  generalized  this  model  to  consider  the  joint  determination 
of  procurement  and  repair  schedules  under  very  general  assuptlons  about  the 
nature  of  the  repair  cost  functions.  Cost  elements  explicitly  considered  In 
the  later  model  Include  set-up  costs,  Idamlng  curve  effects,  expediting  and 
inventory  holding  costs,  and  penalties  for  Incurring  shortages.  The  model 
also  Includes  provision  for  obsolescence  costs  and  time-discounting  effects. 

As  we  shall  see  later,  the  repair  shcedullng  problem  considered  in  this 
ppper  is  a special  case  of  a fixed-charge  Integer  programming  problem  with  a 
special  "block  angular"  structure.  Hence,  one  approach  to  the  repair  scheduling 
problem  Is  to  use  solution  procedures  designed  for  general  fixed  charge  problems. 

Exact  solution  methods  for  fixed  charge  problems  may  be  classified  into 
three  categories:  extreme  point  ranking  procedures  [Gray  (1971),  Murty  (1968], 
branch  and  bound  procedures  [(Jones  and  Solard  (1962)  and  Steinberg  (1970)],  and 
decomposition  methods  [(Kochman  (1976)].  Unfortunately,  these  methods  appear 
to  have  little  practical  value  for  large  scale  problems.  Consequently,  several 
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heurlstlc  approaches  have  been  proposed  that  generate  near-optimal  solutions. 
Generally,  these  heuristics  start  by  producing  a good  extreme  point  solution. 
Adjacent  extreme  points  are  then  examined  until  a local  minimum  is  determined. 

Then  a move  is  made  to  an  extreme  point  away  from  this  local  minimum,  and  the 
process  is  repeated  until  no  further  improvement  is  obtained  or  until  a 
termination  criteria  (such  as  a specified  number  of  interatlons)  is  met. 

Heuristics  of  this  type  are  reported  by  Balinski  (1961),  Cooper  and  Drebes 
(1967),  Denzler  (1969),  Roussean  (1973),  and  Steinberg  (1970). 

A final  line  of  research  relative  to  this  paper  deals  with  recent  developments 
in  the  mathematical  programming  literature.  In  particular.  Agin  and  Cullen 
(1975)  have  developed  a heuristic  procedure  called  reflection  programming  which 
is  a variant  of  the  Dantzig-Wolfe  decomposition  principle.  Agin  and  Cullen 
applied  their  technique  to  a problem  of  transport  routing  and  vehicle  loading. 

They  report  a number  of  computational  advantages  in  applying  reflection  pro- 
gramming to  this  problem.  These  include: 

a.  Integer-valued  solutions.  The  variables  always  satisfy  integer  restrictions. 

b.  Decomposition  of  the  master  program.  Due  to  the  special  structure  of  the 
master  program,  a "reflection  pivot"  can  be  implemented  without  computing 
the  Inverse  of  the  master  problem  basis  matrix.  This  results  in  substantial 
reductions  in  both  computational  requirements  and  computer  core  memory. 


c.  Rapid  Solution.  Agin  and  Cullen  noted  that  their  reflection  programming 
algorithm  terminates  computation  much  more  rapidly  than  the  decomposition 
algorithm. 

Although  reflection  programming  does  not  guarantee  optimal  solutions. 

Agin  and  Cullen  imply  that  very  good  vehicle  routing  solutions  are  achieved 
using  the  technique  though  no  data  supporting  this  contention  is  given.  They 
report  that  truck  routing  problems  involving  7200  equations  in  the  master 
problem,  6000  variables  per  sub-problems  and  31  sub-problems  were  solved  using 
an  IBM  360/65  in  between  1 and  2 minutes  of  CPU  time  including  time  for  set-up 
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II.  A Deterministic  Model 

Let  us  now  develop  a model  that  captures  many  of  the  factors  described 
in  the  previous  section.  Ue  shall  use  the  following  symbols: 

A.  Indices 

1 * 1,2,..., I denotes  the  time  period  under  consideration 
J ■ 1,2,...,J  denotes  a specific  Item  to  be  repaired 

k ■ 1,2,...,K  denotes  a specific  resource  required  in  the  repair  process. 

We  shall  use  the  Index  value  k^’O  to  denote  cost  elements  that  are  part 
of  the  objective  function. 

B.  Status  Variables 

vjj  ■ quantity  of  reparable  units  of  item  j on  hand  at  the  end  of  period  1 
wij  ■ quantity  of  serviceable  units  of  item  j on  hand  at  the  end  of 
period  1. 

Sjj  • slack  quantity  of  resource  k In  period  1;  i.e.  the  quantity  of  resource 
k with  no  planned  utilization  In  period  1. 

C.  Model  Inputs 
1 . Item  data 

■ 

®1J 

* 

* 

’'Ij 

"ij 


■ demand  for  servlcable  units  of  item  j during  period  1 

■ number  of  reparable  units  of  item  j reaching  the  repair  facility 
during  period  1. 

m number  of  reparable  assets  on-hand  at  the  beginning  of  period  1 
> number  of  servlcable  assets  on-hand  at  the  beginning  of  period  1. 

Negative  values  for  wj^j  denote  initial  period  backorders. 

• cost  of  having  one  servlcable  unit  of  Item  j on  hand  at  the 
beginning  of  period  1 
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a|^j  > amount  of  resource  k required  to  "set-up"  and  begin  repair  of  Item 

J • 

b|^j  ■ amount  of  resource  k required  to  produce  one  unit  of  resource  k, 
given  the  job  has  already  been  set-up. 

2.  Resource  data 

bj^l^  - amount  of  resource  k available  during  period  1 

bfk  * maximum  additional  hours  of  resource  k that  can  be  made  available 
In  period  1 by  working  overtime. 

^k  > cost  per  unit  slack  of  resource  1 In  period  k,  l.e.  the  opportunity 
cost  associated  with  each  unit  of  available  capacity  b^j^  that  Is 
not  utilized  In  period  1. 

> cost  per  unit  of  overtime  associated  with  period  1 and  resource  k. 

A > cost  per  unit  of  resource  k that  Is  subcontracted  during  period  1. 

In  this  paper,  we  assumed  R°j^  < R^j^. 

Decision  Variables 

qj^j  ■ quantity  (In  units)  of  Item  j scheduled  for  repair  In  period  1 

“ number  of  hours  of  resource  k to  be  provided  by  overtime  In  period  1. 

^k  a number  of  hours  of  resource  k to  be  provided  from  auxiliary  sources 

(such  as  subcontracting)  during  period  1 

For  simplicity,  we  assume 

a.  Repair  may  be  completed  In  a single  period 

b.  One  reparable  asset  Is  required  at  the  beginning  of  a period  for  each 
serviceable  unit  scheduled  for  completion  during  that  period,  (l.e. 
we  assume  no  Items  are  scrapped  during  the  repair  process) . 

c.  Both  demand  d^j  and  reparable  item  deliveries  e^^j  are  known  determin- 
istically. 
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d.  Backorders  are  not  permitted. 
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For  treatment  of  a more  complex  situation  Involving  multl-perlod  lead  times, 
probabilistic  demand  and  reparable  generations,  and  general  cost  functions, 
see  Demmy  (1975).  For  this  latter  situation,  the  optimization  method  defined 
below  Is  still  appropriate,  but  the  notation  Is  much  more  complex. 


Problem  I.  The  Multi-Item  Scheduling  Problem 

We  wish  to  determine  values  of  q^j,  and  that  minimize  the  total 
costs  of  repair,  holding  Inventory  and  adjusting  resource  levels  during  the 
planning  horizon.  In  symbols,  we  wish  to  minimize  Z, 

In  solving  this  problem,  the  decision  variables  must  satisfy  the  following 
constraints: 

Resources  Required  Must  Equal  Resources  Available 

«2) 

(2)  ®lk  ■ ®lk  “ ^k  " ^’ik 

The  Overtime  limit  cannot  Be  Exceeded 


(3) 


Olki  *£1 


for  all  Ik 


(A) 

(5) 


Initial  On-Hand  Reparable  and  Servlcable  Assets  Are  Known 

* 


'^IJ  - ''ij 


for  all j 


Reparable  and  Servlcable  Material  Balance  Constraints 


<65  vj+i  j - Vjj  - q^j  + e^j 

<^>  ''l+l,)  " + ‘lij  - 


li 

0 


for  all  Ij 
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There  must  be  Enough  Reparable  Assets  to  Support  Scheduled  Repairs 

(8)  for  all  IJ 

Non-Negativity  Conditions 

(9)  q^j,  0 for  all  IJ 

®lk’  ®ik*  ^ik  - ® 

In  addition,  must  be  Integer.  This  problem  is  a mixed  Integer 
programming  problem  with  I(J-l-3K)  variables,  and  I(2K-f2J)  constraints  plus  the 
non-negatlvelty  constraints  (9) . 

Observe  that  (4) , (6) , and  (8)  imply  that 

(10)  v^j  - vjj  + 1 q^j 

which  may  be  rearranged  to 

(11)  qtj  < 

In  addition  observe  that  (5) , (7) , and  (9)  imply  that 

(12)  "i+lj  “ ''ij  ^t-l'^tj  ■ ^t-l‘*tj  - ° 

Together,  these  constraints  place  upper  and  lower  bounds  on  the  cummulatlve 
scheduled  repair,  specifically, 

(13)  ®®*tO,E^^j^d^j-W2j  ] £ E^.^q^j  — ^ij  ^t»l®tj 

The  lower  bound  in  (13)  simply  states  that  the  cunr'^ulative  repair  must  be 
greater  than  or  equal  to  cummulatlve  demands  for  serviceable  items,  net  of 
any  Initial  on-hand  stocks.  The  upper  bound  in  (13)  states  that  the  cummulatlve 
repair  cannot  exceed  the  cummulatlve  reparable  assets  available  at  the  beginning 
of  each  period.  This  upper  bound  defines  the  maximum  production  of  item  j that 
may  occur  by  a given  period  i.  Cummulativc  net  demand  in  excess  of  this  value 
cannot  be  supported  for  lack  of  reparable  carcasses.  In  this  paper,  we  assume 


* 


1^^., 
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^ that  condition  (13)  is  always  satisfied.  In  practice,  this  may  be  accomplished 

by  rescheduling  some  demand  to  later  time  periods,  or  by  satisfying  some  demand 

• • 

^ through  procurement  actions  rather  than  by  repair. 


! ; 
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III.  Approximate  Solution  Using  Linear  Programming 

The  above  model  Is  very  similar  to  capacitated  lot  size  models  studied  | 

by  Manne  (1958),  Dzielinski,  Baker,  and  Manne  (1963),  Dzielinski  and  Gomory  , 

(1965) , and  Lasdon  and  Terjung  (1971) . The  new  feature  In  this  model  Is  the 
addition  of  reparable  asset  constraints  (4) , (6) , and  (8) . 

Manne  suggested  that  approximate  solutions  to  capacitated  lot  size  models  | 

might  be  obtained  using  linear  programming  by  reformulating  problem  (l)-(9) 

as  follows:  Suppose  we  were  to  enumerate  all  feasible  repair  schedules  for  each  * 

item  j,  l.e.  all  schedules  satisfying  constraints  (4)-(9).  Let  Qj^  “ | 

(•ijj  *<l2j denote  the  t^^  schedule  for  item  j.  Further,  let 

(U)  p/  - + hy.bjl 

«ikj  ■ + •>«  Iy 

Now  let  Xj^  be  a (0,1)  “ Integer  variable  such  that  Xj^  = 1 Indicates 
schedule  t is  to  be  adopted  for  item  j,  and  Xj^  = 0 denotes  otherwise.  Then 
the  problem  (l)-(9)  is  equivalent  to  the  problem: 


Problem  II 


(16) 

Min  Z + y^IkSik  + R?k0ik  + RJkAlfcJ 

subject  to 

(17) 

8lkj*J  ^ik~°lk~^lk  “ •’ik 

all  l,k 

(18) 

Oik  - *’lk 

all  l,k 

(19) 

L,  = 1 

all  j 

(20) 

®lk*0lk»^k  - 0 

where  Xj^  Is  Integer. 
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We  shall  refer  to  problem  (16) -(20)  as  Problem  II.  Observe  that  If  the 
Xj ^-Integer  requirement  is  replaced  by  the  constraint 

(21)  i 0 all 

then  problem  II  is  a linear  programming  problem  in  the  variables 

and  A^jj.  This  problem  has  (2IK+J)  - constraints  and  a very  large  number  of 

decision  variables.  For  most  real-world  situations.  Problem  II  is  still  too 

large  to  solve  using  conventional  techniques,  but  by  exploiting  its  special 

structure,  both  computer  memory  and  calculation  requirements  may  be  significantly 

reduced. 

Lasdon  and  Terjung  (1971)  observed  that  the  computational  burden  to  solve 
LP-problems  such  as  (16)-(21)  may  be  reduced  by  using 

a.  delayed  column  generation  procedures  to  identify  Xj^  - variables  that 
are  candidates  to  enter  the  basis. 

b.  generalized  upper  bounding  (GUB)  methods  to  reduce  memory  requirements 
for  storage  of  the  inverse  of  the  basis  to  (16)-(21). 

c.  multiple  pricing  procedures  to  improve  the  rate  of  convergence  toward  the 
optimal  solution. 

Lasdon  and  Terjung 's  procedures  for  GUB  and  multiple  pricing  directly  apply  to 
(16)-(21),  and  will  not  be  discussed  further  here.  However,  their  methods 
must  be  modified  to  apply  delayed  column  generation  to  the  repair  scheduling 
problem. 

To  see  how  this  is  done,  let  denote  the  marginal  cost  associated  with 
variable  x.^, 

j 

(39)  - pj^  - -a  j 


I 


I . 


where  and  Qj  denote  dual  variables  associated  with  (17)  and  (19),  respectively. 
Using  the  standard  simplex  column  selection  rule,  if  there  are  several  schedules 
with  negative  marginal  costs,  we  will  select  the  one  with  the  most  negative 
Cj^.  Hence,  for  a given  item  j,  we  seek  to  identify  the  particular  schedule  t* 


such  thaL 


(40)  Cj  - min [ Cj  t ] - Min  [P^  ikq  jj-  ] 


Note,  however,  that  relation  (40)  Is  equivalent  to  the  single  Item  problem 
of  minimizing  Zj , 


(41)  Zj  - + b.jqJj]-  ^ 

(42)  - [(a^j  + «(qjj)  + (b^j  + ^k’^ik*’ij)qf j+  - “j 

(43)  - Zj  a^^qij)  + bq^j  + b^jw^j  - Oj 

subject  to  the  constraints 

(44)  Vij  - vjj 

(45)  w^j  - 


a • 

« « 

i 

(46) 

^1+1  »J  ■ ^Ij  - 9ij  + ey 

1 

• • 

(47) 

''1+1  »J  ■ ’'i+l»J  ■*■  ‘Jij“‘*ij 

i . 

(48) 

^±i  - ^ij 

* • 

(49) 

‘»ij  » ^ij  *''ij  i 0 

« • 

In 

general,  the  subproblem  (43) -(49)  may 

be  solved  as  a dynamic  programming 

• • 

problem 

with  one  state  variable.  To  see  this 

recall  that  (46)  and  (47)  may  be 

« • 

written 

as: 

I * 

1 . 

(50) 

’'1+1.  J ■ "y  - Cl’lJ 

i; 

(51) 

’'l+l.^  ■ ”ij  ■ 

I 

j 

1 

I 

t 


I 


0 


Let  us  define  rj^j  ■ cummulatlve  units  of  Item  J repaired  In  periods  precedln; 
period  1,  i.e. 


(54)  Zi+i(r)  - 0 


minimum  cost  In  periods  1,  1-fl 


I If  r units  have  been 


repaired  In  periods  preceding  period  1,  and  an  optimal  policy 


Is  followed  In  period  1 and  succeeding  periods 


Values  for  Z^Cr)  may  be  determined  by  backward  recursion  by  evaluating 
Zj(r)  - Min  [^^<30)+  j (wj^j+r+q)  + Z^^j^Crfq)] 

0 < q < v^^  - r 


Feasible  values  for  r are  bounded  by  (13) . In  terms  of  our  current  symbols 


Hence,  It  Is  only  necessary  to  evaluate  (56)  for  Integer  values  of  r satisfying 


At  the  completion  of  the  recursion  calculations,  the  value  Zo(0)  Is 


the  minimum  value  of  Z^  In  (41) ; the  associated  repair  schedule  may  then  be 


found  by  a standard  backtracking  calculation 
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Section  IV.  Reflection  Progranmlng 


As  noted  above,  Agin  and  Cullen  (1975)  have  developed  a heuristic  procedure 
called  reflection  programming  which  is  a variant  of  the  Dantzlg-Wolfe  decomposition 
principle.  They  report  a number  of  computational  advantages  of  their  method 
!•  in  applying  reflection  programming  to  problems  of  transport  routing  and  vehicle 
loading.  These  Include  rapid  solution,  small  computer  memory  requirements,  and 
the  property  that  variables  always  satisfy  Integer  restructions.  In  this 
I section,  we  develop  the  mathematics  required  to  apply  reflection  programming  to 
multi-item  repair  scheduling  problems.  In  the  next  section,  we  report  computa- 
' tlonal  experience  with  this  method. 

T"  The  major  steps  involved  in  applying  reflection  programming  to  the  repair 

I. 

scheduling  problem  are  outlined  in  Figure  IV-1. 

Basically,  the  algorithm  works  by  requiring  that  at  any  given  time  there 
is  one  and  only  one  non-zero  associated  with  each  item  j.  Once  an  initial 

I 

* * solution  is  established,  the  algorithm  proceeds  by  considering  each  item  In 
^ * succession.  When  a given  item  is  considered,  shadow  prices  associated  with 

P • 

each  resource  are  used  to  determine  a trial  schedule  Qj*  that  represents  a 

m m 

^ ^ ($^arginal  improvement  over  the  existing  schedule  Qj  for  the  current  item — the 
IP  . same  as  in  Dantzlg-Wolfe  decomposition.  However,  reflection  programming  requires 

I 

* * that  an  entering  schedule  must  completely  replace  the  previous  schedule.  This 

* * one-for-one  replacement  will  generally  require  adjustments  in  the  basis  variables 

A • 

associated  with  constraints  (17)-(18). 

These  adjustments  are  referred  to  as  the  reflection  pivot,  since  the  impact 
of  the  schedule  change  is  being  "reflected"  into  its  corresponding  resource 
adjustments.  In  general,  exchanging  the  current  schedule  for  the  trial  schedule 
will  decrease  resource  costs,  but  will  Increase  production  and  inventory  costs — 
particularly  when  demand  Is  highly  seasonal.  If  the  total  of  these  cost  changes 


Schedule 
3it  Same  as  Currei 
fti«7 


iRaad  Input 


Set  Up  Initial  Schedule,  Deternlne 
DItcct  Costs,  Resource  Usage, 
Resource  Cost,  and  the  Total  Cost 


Begin  Optimization  With  Item  1, 
Determine  Marginal  Cost  Associated 
With  Each  Constraint 


Compute  a Revised  Schedule  for  Item  J 
(a)  Modify  Cost  to  Reflect  Shadow  Price 
In  Aleorlthm 


Figure  IV- 1 


(1)  Compute  Revised  Resource  Requirements 

(2)  Compute  Revised  Total  Cost 


— Does  Revlsed^v. 
^Schedule  Reduce  Tot^ 
^"Vj/etem  CostL^^^ 


Bdopt  Revised  Schedule  and  Recerd 
Rev  Costs  and  Resource  Requirements 
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Flow  niaeram  of  Reflection  Programming 
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produce  a net  Improvement  In  the  objective  function,  the  new  schedule  Is 
adopted.  If  there  Is  no  net  Improvement,  the  next  Item  Is  considered.  This 
process  Is  continued  until  each  of  the  Items  has  been  considered  without  adopting 
a new  schedule;  when  this  happens,  the  algorithm  stops. 

In  essence,  reflection  programming  Is  a heuristic  specialization  of  the 
simplex  method  to  exploit  the  particular  problem  structure  considered  here. 

To  see  this,  recall  that  the  revised  simplex  method  Involves  the  following 
steps: 

1.  Obtain  an  Initial,  basic  feasible  solution 

2.  Determine  dual  variables  associated  with  the  current  basis 

3.  Determine  a new  column  to  enter  the  basis.  If  a column  can  be  found  whose 
marginal  cost  Cj  Is  negative,  the  objective  function  may  be  reduced  by 
entering  this  column  Into  the  basis.  If  there  are  several  columns  with 

Cj  < 0,  the  column  with  the  smallest  Cj  value  Is  selected  for  basis  entry. 

4.  Determine  the  variable  to  leave  the  basis,  and  check  for  an  unbounded 
solution. 

5.  Update  the  Inverse  of  the  current  basis  and  return  to  step  2. 

Let  us  now  explore  how  the  special  structure  of  Problem  II  may  be  exploited 
in  applying  each  of  the  steps  of  the  simplex  method. 

Step  1.  Obtain  an  Initial,  basic  feasible  solution  (BPS).  In  this  paper  we  assume 

that  additional  resources  may  always  be  obtained.  Hence,  a feasible 

schedule  can  be  obtained  by  first  computing  an  Initial  schedule  for  each 

Item  that  satisfies  (4)-(9)4  and  then  setting  the  resource  variables 

and  to  provide  the  required  resources.  Because  of  the  cost 

structure  assumed  here,  we  would  obtain  the  required  resources  by  first 

o 

using  up  any  slack,  then  scheduling  overtime  up  to  the  maximum  of  bj^j^  hours, 
and  then  using  auxilary  repair  sources  With  this  assumption,  a feasible 
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schedule  for  each  item  may  be  obtained  by  performing  the  following 
calculations: 


* * (60)  - max 

t * 

. . (61)  q2j  - max  (0,dj^j+d2j-Wij 


and  in  general, 

(62)  q^j  - max  (0,  ^t»l‘*tj“”lj^ 

This  fancy  math  corresponds  to  scheduling  repair  to  just  meet  net 
demand.  No  attempt  is  made  to  minimize  holding  and  set-up  costs. 

Step  2.  Determine  simplex  multipliers. 

Let  and  Oj  denote  dual  variables  associated  with  (17),  (18) 

and  (19),  respectively.  Then  the  dual  of  Problem  II  and  the  associated 
primal  variables  are  given  by: 

(63)  Max  Iiktiiikbik-6ikbJ^]  + 
subject  to 

(64)  Xj  ; 


(65)  ..  S^j^: 


(66)  0 ; 


(67) 


<^ik 


i<k 


i*ik 


From  the  complementary  slackness  theorem  of  linear  programming,  if  a given 
variable  is  in  the  basi^,  the  corresponding  dual  constraint  holds  is  an 
equality.  Further,  the  dual  variable  corresponds  to  the  overtime 
constraint  (18).  Hence  ®lk^  ^ik* 
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Ue  can  Identify  three  specific  cases  associated  with  each  resource. 


They  are: 

m « 

Case 

_A. 

If  > 0,  overtime  must  be  zero,  which  implies  Also  from 

(65), 

(69) 

» - R?v 

ik 

• 

Case 

_B. 

If  0 < < b°j^,  we  still  have  = 0.  Hence,  (66)  must 

hold  as 

an 

• m 

equAl^ty,  which  implies  that: 

• • 

(71) 

nk  ■ 

- 

Case 

_C. 

If  A^j^  > 0,  relation  (67)  must  be  an  equality.  Hence, 

• « 

(72) 

- -R^ 
trik  “ik 

* “ 

Relation  (66)  must  also  be  an  equality,  since  0j_j^  Is  positive. 

thus 

• • 

(73) 

..A  _o 

6ik  ” ^ik  ■ %k 

« m 

In 

all  three  cases  above,  if  and  are  known  for  all  ik. 

and  if 

is  in  the  basis,  then  from  (64), 


(74)  a j " Pj  - likT^k^ijk 

To  summarize,  the  dual  variables  associated  with  a given  basis  may  be 
established  by  considering  each  resource  separately.  For  a .given  resource  , 

^ik  "^ik  easily  determined  by  applying  formulas  (69)  - (73)  as  appropriate. 


Once  these  values  are  determined,  may  be  computed  using  (74). 


Step  3. 


Determine  a new  column  to  enter  the  basis.  First,  let  us  condider 

A A . 

the  resource  variables.  Let  0°^^,  and  ‘^ik  denote  the  marginal  cost 

associated  with  the  resource  variables  and  respectively. 

"Pricing  out"  each  of  these  variables  gives  us 


(75) 

(76) 

(77) 


Cfk 


^ik  “ '^ik 


'tk  ■ *ik  * \k 

cjk  - nfk  + ” 


Ik 


Ik 


h : 


li 


Suppose  there  is  slack  in  the  basis  (S.,  > 0).  Then  Case  A above  holds,  giving 


If  case  A holds,  increasing  either  the  overtime  of  subcontracting  variable  will 


Increase  the  objective  function 


Now  suppose  Case  B above  holds,  i.e.  some  overtime  is  beip^  worked.  Then 


increasing  S or  A would  Increase  the  objective  function 


Finally,  suppose  Case  C holds.  Then  C 


Again,  the  objective  function  cannot  be  decreased  by  increasing  one 


To  summarize,  the  objective  function  can  never  be  reduced  by  bringing  one  of 


the  resource  variables  into  the  basis.  Hence,  these  variables  need  not  be  coa 


sldered  as  candidates  for  basis  entry  at  this  step 


In  Section  III,  we  discussed  how  a single  item  dynamic  programming  problem 


may  be  solved  to  identify  a particular  schedule  with  the  lowest  marginal  cost.  The 


Once  the  dual  variables 


and  a,  are  known,  a dynamic  programming  problem  may  be  solved  to  determine  the 


best  candidate  schedule  Q,  associated  with  a given  item  j.  If  the  marginal  cost 


associated  with  this  schedule  is  negative,  the  algorithm  then  applies  another 


test:  Will  the  objective  function  be  Improved  if  the  current  schedule  Q.  for  item 


j Is  replaced  by  this  schedule?  This  second  test  is  a departure  from  the  simplex 


method,  which  will  Introduce  a variable  into  the  basis  (perhaps  at  a fractional 


< 0.  This  second  test  qunrantees  tl)at  the  integer  nature 


level)  whenever  C 


of  reflection  programming  solution's  is  retained,  but  it  destroys  the  quarantee  of 


eventual  optimality  inherent  in  the  simplex  method 
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If  both  tests  are  satisfied  the  algorithm  proceeds  to  step  4.  Other- 
wise, another  item  j is  considered.  This  process  of  solving  item  scheduling 
problems  continues  until  either  (a)  both  tests  are  passed,  or  (b)  all  items 
have  been  considered.  In  the  latter  case,  the  algorithm  terminates. 

* 

Step  4.  Determine  variable  to  leave  the  basis.  If  a new  schedule  Qj  has 
been  found  that  passes  both  tests  above,  the  associated  Xj^  is  to 
enter  the  basis,  and  the  Xj^  associated  with  the  old  item  schedule 
is  to  leave.  In  making  this  one-for-one  exchange,  however,  several 
of  the  resource  variables  and  may  be  affected. 

However,  the  required  adjustments  are  easily  determined  by  computing 
the  differences  in  resource  requirements  associated  with  the  old 
and  new  schedules. 


u 

u 

[! 

u 


step  5.  Update  the  Inverse  of  the  current  basis. 

As  we  have  seen  all  of  the  above  steps  may  be  performed  without 
reference  to  the  Inverse  of  the  current  basis.  Hence,  there  is  no 
need  to  store  nor  to  update  the  inverse  in  applying  reflection 
programming.  This  is  one  of  the  major  computational  advantages 
of  the  method. 


I 


1 
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Section  V.  Computation  Experience 


To  evaluate  the  potential  usefulness  of  Reflection  Programming  (RFLP), 
we  performed  two  types  of  computational  experiments.  In  the  first  computational 
experiments,  we  compared  RFLP  results  with  solutions  obtained  using  independent 
Item  assumptions.  Cur  second  experiment  compared  RFLP  results  with  those 
obtained  using  Generalized  Upper  Bounding  (GUB). 

RFLP/Indpendent  Item  Comparison 

To  test  the  characteristics  of  reflection  programming,  we  formulated 
a scenario  Involving  4 resources,  12  planning  periods,  and  170  Items  for 
the  Vfanndot  Company,  a hypothetical  manufacturing  firm  studied  extensively 
by  Brown  (1967).  When  stated  as  an  Integer  optimization  problem  In  the 
form  of  (l)-(9),  the  resulting  problem  has  266  constraints  and  over  340,000 
columns — an  optimization  problem  with  substantial  dimensions.  The  data  for 
this  scenario  was  constructed  by  a Monte  Carlo  Process  to  have  the  same 
statistical  characteristics  as  the  top  170  Items  In  the  tfarmdot  inventory. 

Four  basic  data  sets  were  generated,  each  with  differing  degrees  of  seasonality 
as  outlined  In  Table  V-1. 

Reflection  programming  was  applied  to  each  of  the  data  sets  under  two 
different  cost  structures;  hence  a total  of  eight  runs  was  performed.  In 
the  first  cost  structure.  It  was  assumed  that: 

Cost  per  hour  slack  - $4.00 

Cost  per  hour  overtime  ~ $6.00 

Cost  per  hour  subcontracted  *■  $60.00 

Cost  per  period  for  holding  inventory  = 2%  of  unit  cost 

Set-up  cost  ■ $1.00 

The  second  cost  structure  was  Identical  to  the  above,  with  the  exception  that 
the  cost  of  slack  was  set  to  zero. 
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In  all  tests,  an  initial  schedule  was  obtained  by  applying  the  Wagner- 
Whltln  algorithm  to  each  Item  Independently.  Reflection  programming  was 
then  applied  In  an  attempt  to  Improve  the  Initial  schedules. 

Results  of  our  experimental  runs  are  shown  In  Table  V-2.  These  runs 
demonstrate  the  speed  of  the  reflection  programming.  In  all  eight  runs.  It 
took  90  seconds  or  less  of  CPU  time  of  IBM  360/65  to  reach  a heuristic  sol- 
ution. When  the  demand  rate  Is  constant,  the  cost  reduction  from  Che 
Initial  solution  to  the  final  solution  wer6  either  moderate  (19%)  or  insigni- 
ficant (1.3%).  However,  when  seasonality  is  present,  the  cost  reduction  was 
substantial,  ranging  from  82%  to  97%.  These  results  are  quite  encouraging, 
since  significant  cost  reductions  were  obtained  fronvery  modest  expenditures 
of  computer  time. 


i 

IT 


Table  V-1 

Tour  Types  of  Demand  Rate 


betiand  Rate 

Distribution 

Constant  Rate 

Monthly  demand  Is  normally  distri- 
buted at  a constant  rate  through  the 

year 

Mild  Seasonal 

Maximum  monthly  demand  <■  20Z  of 
annual  demand 

Minimum  swnthly  demand  • ZZ  of 
annual  demand 

Hishly  Seasonal 

Mexlnuim  monthly  demand  ■ 30Z  of 
ennuel  demand 

Minimum  monthly  demand  • IZ  of 
annual  demand 

Estreate  Seasonal 

Range  from  3 months  of  "O"  demand  up 
to  2SZ  per  month  of  the  annual 

demand 

Table  V-2 

SifBftary  of  Experimental  Rune 


Constant  Demand  Rate 

Mild  Seasonal  Rate 

Highly  Seasonal  Rate 

Extremely  Seasonal 

Statistics 

Cost  of  Slack 

Cost  of  Slack 

Cost  0 

f Slack 

Cost  of 

Slack 

$4.00 

Not  Cost 

$4.00 

No  Cost 

$4.00 

Not  Cost 

$4.00 

Not  Cost 

Initial  Solution 

$131,352 

$ 5,085 

$3,867,611 

$2,507,409 

$6,298,966 

$5,562,524 

$3,738,943 

$2,911,761 

Final  Solution 

129,689 

4,120 

358,505 

84,141 

697,868 

288,630 

677,430 

76,598 

ll««ber  of  Taasea 
Through  Each  Item 

7 

5 

146 

140 

144 

139 

92 

92 

Total  CPU  Time 
(la  aeconda) 

46 

30 

56 

1 

90 

57 

52 

43 

# 

72 

Fereant  of  Cost 
Reduction  from 
Initial  Solution 

Co  Final  Solution 

1.3Z 

19X 

9U 

97Z 

89Z 
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95Z 

822 

97Z 
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RFLP/GUB  Comparisons 

• • Originally,  we  Intended  to  compare  the  RFLP  and  GUB  algorithms  in  the 

same  senarlo  as  described  above.  However,  our  GUB  algorithm  has  proven  to 
be  quite  inefficient  (and  extremely  expensive.).  It  appears  that  the  inefficiency 
la  due  to  the  way  we  store  and  retrieve  data  in  the  algorithm,  rather  than  a 
problem  with  the  algorithm  itself,  but  we  are  still  not  certain  as  to  the  exact 
problem.  Hence,  our  comparlsdns  have  been  restricted  to  much  smaller 
problems. 

I As  illustrated  in  Table  V-3 , four  problems  were  solved  using  the  RFLP  and 

GUB  algorithms.  In  all  cases,  GUB  produced  a lower  cost  solution,  but  required 
' from  3 to  10  times  as  much  CPU  time.  For  these  small  problems  the  reduction  in 

^ schedule  cost  produced  by  GUB  easily  pays  for  the  increased  computer  costs. 

' For  larger  problems,  however,  this  may  not  be  true.  For  example,  in  attempting 

t 

to  solve  the  4 resource,  12  period,  170  item  problem  discussed  above,  our  GUB 
algorithm  run  was  terminated  at  1200  seconds  of  CPU  time.  In  contrast,  RFLP 
reached  it’s  final  solution  in  90  seconds  for  this  problem,  and  the  final  RFLP 
solution  was  better  than  the  GUB  solution  at  the  time  of  termination. 

Unfortunately,  our  GUB  code  appears  to  be  very  inefficient,  so  that  it  is 
difficult  at  this  time  to  conclude  which  method  would  be  most  efficient. 
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Table  V-3.  Comparison  of  RFLP  And  GUB  Solutions 

Computer 


1 

Solution 

CPU 

Job 

• • 

Resources 

Periods 

Items 

Method 

Total  Cost 

8ee 

Change  $ 

« * 

1 

6 

50 

RFLP 

6,608 

10 

$ 1.25 

^ •• 

GUB 

4,492 

65 

$ 5.50 

• m 

1 

12 

50 

RFLP 

5,795 

16 

$ 1.80 

i 

GUB 

4,570 

169 

$10.31 

m m 

2 

4 

10 

RFLP 

1,161 

4 

$ .75 

r 

• • 

GUB 

367 

14 

$ 1.35 

m • 

2 

4 

20 

RFLP 

3,852 

5 

$ .89 

• » 

GUB 

2,772 

24 

$ 2.06 
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